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(57) Abstract 

In a method for processing digital color images derived from photographic film, the method employing color repro- 
duction functions generated by normalizing random samples of color values from different colors, sampling of color va- 
lues from noisy areas of an image, or scanner noise can distort the randomness of sampling and result in unwanted con- 
trast reductions and color shifts in the processed digital images. The problem is solved by correcting the shapes of the 
distributions of color value samples toward a normal distribution having the same mean and standard deviations as the 
sample distribution, prior to forming the color reproduction function. 
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Digital color image processing with 
histogram shape correction. 

5 Technical Field 

The present invention relates to a method of 
processing a digital color image derived from 
photographic film, and more particularly to such a 
method employing a plurality of color reproduction 

10 functions generated by normalizing samples of color 
values selected from the informational portions of 
the image, the color reproduction functions being 
applied to the digital color image to produce a 
processed digital color image. 

15 Background Art 

A digital image processing method has been 
proposed wherein a random sample of tone values from 
the informational portion of the digital image is 
normalized to produce a tone reproduction function. 

20 The tone reproduction function is then applied to the 
digital image to produce a processed digital image. 
This procedure was first proposed in the article 
entitled "A New Approach to Programming in 
Photomechanical Reproduction" by Yu. Ovchinnikov et 

25 al. f 12th IARIGAI Conference Proceedings, Versailles, 
France, Editor W. Banks, IPC Science and Technology 
Press, Guildford, England, 1974, pages 160-163. It 
has been discovered that the success of the method 
depends strongly upon choosing a truly random sample 

30 of tone values from the image. An improvement to the 
randomness of the sampling by selecting the tone 
values from a "floating" image dependent contrast 
interval having certain preferred statistical 
properties is disclosed in U.S. Patent Application 

35 Serial No. 730,630, filed May 6, 1985 by the present 
inventor. A further improvement, wherein the overall 
contrast of the image is adjusted as a function of 
the standard deviation of the tone values of the 
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image and the tone reproduction function is expressed 
in terms of the standard normal variate is disclosed 
in Patent Application Serial No. 730,629, filed May 
6, 1985 by the present inventor. 
5 An extension of the method to processing 

digital color images to adjust both tone scale and 
color balance is disclosed in Patent Application 
Serial No. 730,627, filed May 6, 1985 by the present 
inventor. In the extension to digital color images, 

to: a color reproduction function is produced for each of 
a plurality of color components (e.g. red, green and 
blue) in the digital image by normalizing respective 
samples of color values selected from the 
informational part of the image. The color 

15 reproduction functions thus produced are then applied 
to the respective color components of the digital 
color image to produce the processed digital color 
image. An output device is calibrated so that 
combinations of color values having equal values of 

20 the standard normal variate in the color reproduction 
functions produce a neutral (gray) color. 

This method generally produces an aesthetic 
improvement in the appearance of processed color 
images, however when the digital color image is 

25 derived from a color photographic film image 

containing textures such as, noisy blue sky, foliage 
or film grain noise due to under exposure, or when 
noise is introduced by the image scanner, the 
randomness of the sampling procedure for producing 

30 the samples of color values for normalization is 
subject to influence, thereby distorting the color 
reproduction functions and causing unwanted contrast 
reduction or color shifts in the processed images. 

It is apparent from the examination of such 

3 5 processed images that further improvement in the 
digital color image processing method is desirable. 
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It is the object of the present invention to 
provide an improved digital color image processing 
method of the type described above , wherein the tone 
scale of processed images having textured or noisy 
5 areas are improved. 

Disclosure of the Invention 

The object of the invention is achieved by 
correcting the shapes of the distributions of color 
values toward a normal distribution having the same 
10 mean and standard deviation as the sample 

distributions prior to forming the color reproduction 
functions. 

In a preferred practice of the method, the 
correction comprises forming the cumulative 

15 probabilities of the sample of color values, forming 
a normal set of cumulative probabilities having the 
same mean and standard deviation as the sample 
distribution, and forming the square root of the 
joint probabilities of the two sets of cumulative 

20 probabilities. Finally, the posterior probabilities 
are computed from the joint probabilities. 

Fig. 2 is a graph showing how a color 
reproduction function is generated. The upper 
left-hand quadrant of the graph shows a histogram 

25 labeled A of a sample of color values (photographic 
densities) taken from an informational portion of the 
image. The sample is plotted against relative 
frequency of occurrence. The lower right-hand 
quadrant of the graph shows a histogram labeled B of 

30 a normal (Gaussian) distribution showing the relative 
frequency of occurrence vs the standard normal 
variate Z. The standard variate Z is a scale in 
units of standard deviations of a Gaussian 
distribution. In the upper right-hand quadrant is 

35 shown a transformation function labeled C that 

transforms the distribution of the measured sample of 
color values to the normal distribution. This color 
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reproduction function relates any given color value 
in the measured distribution to a value of Z. The Z 
value is a dimensionless quantity representing 
numbers of standard deviations. To process the 

5 digital image, the measured color values in the 
digital color image are converted to Z values using 
the color reproduction functions. The resulting 
dimensionless quantities are given dimension by 
multiplying the Z values by a constant to determine 

10 the contrast of the processed image, and adding a 
constant to the Z values in the respective colors to 
adjust the color balance of the processed image. The 
additive constants are chosen such that equal Z 
values in all three colors produce a neutral (gray) 

15 color. 

If the samples of color values used to 
generate the color reproduction function were not 
truly random,* the shapes and relationships of the 
color reproduction functions will be distorted, 
20 resulting in undesirable contrast reduction and color 
shifts in the processed image. 

Fig. 3 shows an actual set of red, green and 
blue color reproduction functions labeled R, G and B, 
respectively, that were generated according to the 
25 process described above, from a photographic negative 
having an extremely underexposed background. The 
kinks in the middle of the color reproduction 
functions are due to the non-random sampling caused 
by the film grain- They result in a distorted tone 
30 scale in portions of the processed image. 

The present invention is motivated by the 
theorem of Bayesian statistics which says, in effect, 
that the statistics of the joint probabilities 
between an expected prior distribution and a random 
3 5 sample of a sampling distribution will better 

represent the statistics of the actual distribution 
then will the statistics of the random sample alone. 
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The basic assumption of the image processing method 
as originally proposed by Ovchinnikov et al. was that 
a random sample of tone values taken from the 
informational portion of the image will form a normal 
5 distribution. Therefore, applying the above noted 
theorem, the shape of the histogram of the actual 
sample of color values is corrected such that the 
translation of the original image moves toward a 
normal distribution. 
10 This is accomplished, according to the 

present invention, by taking the square root of the 
joint probabilities between the actual sample and a 
normal distribution having the same mean and standard 
deviation as the actual sample. Fig. A shows a plot 
15 of probability density vs. photographic density of an 
actual sample of color values for one of the three 
color layers, taken from the same image from which 
the color reproduction functions shown in Fig. 3 were 
generated. The solid curve in Fig. 4 represents the 
20 original data, the chain curve represents a normal 
distribution having the same mean and standard 
deviation as the sample distribution, and the dotted 
curve represents the square root of the joint 
probability of the two distributions. The step of 
25 histogram shape correction was first applied to all 
three color samples, then the color reproduction 
functions were generated by normalizing the shape 
corrected histograms, resulting in the set of color 
reproduction functions shown in Fig. 5. The image 
30 reproduced with this set of color reproduction 

functions was noticeably improved with respect to the 
image produced from the color reproduction functions 
shown in Fig. 3. 

In many cases, the histogram shape 
35 correction method has resulted in a visual 
improvement in the processed image, and in no 
instance has the histogram shaped correction method 
resulted in a degradation of the processed image. 
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Brief Description of the Drawings 

Fig. 1 is a block diagram illustrating the 
basic steps of generating color reproduction 
functions according to the present invention; 
5 Fig. 2 is a graph useful in describing the 

generation of the color reproduction function; 

Fig. 3 is a plot of a set of color 
reproduction functions generated according to the 
prior art method; 
10 Fig. 4 is a graph illustrating the 

correction of histogram shape according to the 
present invention; 

Fig. 5 is a plot of a set of color 
reproduction functions generated according to the 
15 method of the present invention; 

Fig. 6 is a schematic diagram showing scan 
printing apparatus for practicing the present 
invention; 

Fig. 7 is a schematic diagram illustrating 
20 the organization of histogram memories used to 

compile color value histograms in the apparatus shown 
in Fig. 6; and 

Figs. 8 through 12 are flow charts 
illustrating the operation of the apparatus of Fig. 6 
25 according to the present invention. 
Modes of Carrying Out the Invention 

The method of digital color image processing 
according to the present invention will first be 
described with reference to Fig. 1. In Fig. 1, a 
30 scanner 10, scans a color film image to provide a 
digital color image signal having three color 
components R, G and B. A digital computer 12 
receives the digital color image signal and is 
programmed, as described below, to provide a sampler 
35 and histogram compiler 14 for sampling the color 

values from the informational portion (edges) of the 
digital image and compiling histograms H , H Q , 
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and of the sampled color values in the 

respective colors. A histogram shape corrector 16 

corrects the shapes of the histograms toward normal 

histograms having the same mean and standard 

5 deviation as the sample histogram to produce shape 

corrected histograms H R f # H G f f and Hg f . A 

histogram normalizer 18 receives the shape corrected 

histogram data H R * f H G f , and Hg, and generates 

a set of functions Z , Z and Z, that 

r g o 

10 normalize the respective histograms. The functions 
Z r> Z g and Z^ are the color reproduction 
functions employed to process the color digital 
image as described below. 

Turning now to Fig. 6, an example of a 

15 scanning printer used to practice the present 
invention will be described. The input device 
includes a light source 20 and lens 22 for 
projecting an image of color negative film 24 onto 
three solid state image sensing arrays 26, such as 

20 CCD image sensors. The image is directed to the 

image sensing array 26 by dichroic beam splitters 28 
through color trimming filters 30, to form a red, 
green and blue separation image on the respective 
image sensors 26. A film advance motor 31 advances 

25 the film in the printer. The image sensors 26 scan 
the color photographic negatives to produce three 
color separation signals R, G and B. The signals 
thus produced are supplied to analog-to-digital 
converters 32 that each produce an 8-bit output code 

30 representing one of 256 possible signal levels for 
each sample point in the three colors. 

The digital color image signals are stored 
in a digital image storage memory 34 , such as a 
magnetic tape, disc, or solid state semiconductor 

35 memory. The digital color image signals were 
processed in a digital computer 36. A DEC 2060 
mainframe computer was used in the initial 
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experiments, later a special purpose digital image 
processing computer was used to increase the 
processing speed. 

The digital computer 36 is programmed to 

5 include a color reproduction function generator 38 
and a digital image processor 40 that applies color 
reproduction functions generated by color 
reproduction function generator 38 to the digital 
color image. The color reproduction function 

Hi generator 38 receives the color digital image from 
the digital image storage device 34 via data and 
control bus 35 and generates a color reproduction 
function for each color. The color reproduction 
functions are supplied to the digital image 

15 processor 40 as color reproduction function look-up 
tables 42 that are used to process the digital color 
image. The color reproduction function generator 38 
also generates a multiplicative constant <* z for 
adjusting the contrast of the processed image as 

20 described below and supplies the constant to output 
calibration tables 44 in the digital image processor 
40. 

Prior to storing the digital color image in 
digital image store 34 f each input signal level is 

25 converted to an input color value (such as 
photographic density), by a known scanner 
calibration function. The calibration function for 
each color is implemented in the form of a look up 
table 46 in the digital image processor 40, to 

30 convert each 8-bit input value to an 8-bit value 
representing the color negative density at the 
scanning point. 

The color reproduction function generator 
38 includes digital filters 48 for performing a 

3 5 block average of the color values of the digital 

color image. Digital filters 50 detect the contrast 
of the image around each block averaged color value 
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in each of the three colors. A histogram compiler 

52 compiles the block averaged color values from a 

plurality of contrast intervals in each color, in a 

plurality of histogram memories 54. 

5 Fig. 7 shows, in a graphic way, the 

organization of one of the histogram memories 54 for 

one of the colors. There are twenty contrast 

intervals having a width of .04 log contrast units 

each. The width of the contrast intervals was 

10 chosen to be approximately twice the minimum visual 

log contrast threshold. The 256 color values are 

divided into 80 color value (density) bins, for a 

resolution of .05 density units per bin. Counts are 

accumulated in the appropriate color value bins in 

15 the histogram memories 54 until all of the color 

values from the digital color image are counted. 

Returning to Fig. 6, a statistics computer 

56 computes the first four standardized statistical 

moments v of the distributions of color values in 

20 the histogram memories 54 as described below. 

A contrast interval selector 58 selects a 

contrast interval on the basis of the statistics of 

the distributions of color values in the contrast 

intervals. The contrast interval selector 58 

25 supplies the color value histograms H from the 

selected contrast interval to a histogram shape 

corrector 60. The histogram shape corrector 60 

corrects the shapes of each of the color value 

histograms H toward a normal histogram having the 

30 same mean and standard deviation as the color value 

histogram. The shape corrected histograms H' are 

applied to a histogram normalizer 62. Histogram 

normal izer 62 normalizes the shape corrected 

histograms H of color values from the selected 

3 5 contrast interval to generate the color reproduction 

functions Z , Z„ and Z. . 

r g o 
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A contrast adjustment computer 64 receives 

the statistics u Q of the green distribution from 

the contrast interval selector 58 and produces a 

multiplicative constant <* used to determine the 

z 

5 contrast of the processed image. The multiplicative 

constant a is provided to the output device 
z 

calibration tables 44. Alternatively, the 

multiplicative constant a can be incorporated 

z 

into the color reproduction function tables 42. The 
10 color reproduction function look-up tables 42 relate 
each of the 256 possible input values in the 
respective colors to one of the 256 possible output 
values. 

After the color reproduction function 
15 look-up tables 42 have been generated, the digital 
image processor 40 processes the digital image by 
applying the color reproduction functions to the 
respective color components of the digital color 
image. The output calibration functions are then 
20 applied to the respective color components of the 
processed digital color image. The processed 
digital color image is converted to analog form by 
digital-to-analog converters 66. The processed 
analog color signal is then applied to an output 
25 scanning device 68 to reproduce the processed color 
image . 

The output device 68 is a drum type scanner 
having red, green and blue laser light sources 70 
that are modulated by the respective analog color 

30 signals to expose a light sensitive medium such as 
color photographic paper. 

System control electronics 72 controls and 
coordinates the operation of input and output 
scanning devices and the signal processing computer. 

3 5 The method of digital color image 

processing using shape corrected histograms will 
now be described in more detail with reference to 
the flow charts of Figs. 8-12. 
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Ref erring first to the flow chart of Fig. 
8, the processing steps performed on the digital 
color image to generate the respective color 
reproduction functions will be described. All three 
color components are processed through these steps. 
First a block average of the color values of the 
sampled digital image is formed. This is 
accomplished by applying a digital filter to the 
digital image color values of the form: 



1 
1 
1 
1 



1 
1 
1 
1 



1 
1 
1 
1 



1 
1 
1 
1 




(1) 



20 



This averaging is performed by the block average 
filters 48, shown in Fig. 2 to reduce the effects of 
film grain on the color value statistics. 

Next, a digital filter representing a 
Laplacian operator of the form: 



25 



30 



35 



0-10 
-1 4 -1 
0-10 



(2) 



is applied to the block averaged color values of the 
digital color image to measure the contrast of the 
image at each block averaged sample point. This 
operation is performed by the contrast measurement 
filter 50 in Fig. 6. The Laplacian operator has the 
properties of exhibiting no response to uniform 
areas or linear gradients, and exhibits a response 
only to changes in gradients. The Laplacian 
operator works well in measuring the contrast of the 
image, however it is to be understood that other 
contrast measuring filters may be employed. 
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The respective histograms in each contrast 
interval for each color component are compiled as 
discussed above, and their statistics are computed. 
A contrast interval is selected on the basis of the 

5 statistical parameters of the color value 

distributions in the contrast interval. The shapes 
of the histograms are corrected toward a normal 
histogram having the same mean and standard 
deviation, and the shape corrected histograms of 

10 color values in the selected contrast interval are 

normalized to generate the respective color 

reproduction functions for each color. 

An overall contrast adjustment parameter 

a is calculated as a function of the standard 
z 

15 deviation of the green color values in the selected 
contrast interval. 

Fig. 9 is a flow chart showing the steps 
involved in compiling the histogram statistics for 
each contrast interval value. The raw moments 

20 taken about the mean, are computed as follows: 



H - - 

N 



N 

z 

i=l 



I ( x, - x ) k 



(3) 



where 

25 N is total number of samples in the 

contrast interval; 

is a color value; and 
x is the mean color value. 
The standardized central moments v\ are 
30 calculated as follows: 



u* k - L_ . where a = ✓ u 2 (*) 

a* 

The coefficient of symmetry (slcewness) for each 
3 5 distribution is then represented as 

B x - (u^) 2 (5) 
and the coefficient of pealeedness (kurtosis plus 3) is 

represented as 
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3 2 - M\ (6) 
Referring to Fig. 10, the contrast interval 

selection criteria involves the similarity of shape 

of the three color distributions in the contrast 
5 interval. The selection criteria compares the 

skewness of the color value distributions in each of 

the contrast intervals as follows: 

(7) 

SUM X (N) - I 3 1R - 3 1(J I + I 3 1B - 3 1G I + I 3 1R - * 1B 

10 where SUM 1 (N) is a measure of the difference in 

skewness between the three color value distributions 
in the Nth contrast interval. The contrast interval 
having the most similar distribution, i.e. the 
lowest value of SUM 1 (N) is identified. 

15 Next, the peakedness of the three color 

value distributions in each contrast interval is 
compared as follows: 

(8) 

SUM 2 (N) = I 3 2R - 3 2G I + I S 2B - I + I 3 2 R - *2B 

20 where SUM 2 (N) is a measure of difference in 
peakedness between the three color value 
distributions in the Nth contrast interval. The 
contrast interval having the most similar 
distributions, i.e. the lowest value of SUM 2 (N) 

25 is identified. 

Finally, the lowest contrast interval (i.e. 
the interval representing the lowest contrast) 
between the two identified contrast intervals is 
selected. 

30 Turning now to Fig. 11, the steps involved 

in correcting the shapes of the selected color value 

histograms will be described. 

First an average smoothing operation is 

performed on the selected color value distribution 
3 5 to remove any spikes. The smoothing is performed on 

the counts in 3 consecutive color value bins as 

follows: 
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h ± - 1/3 (h' ti _ ! + + + x ) (9) 
where h'^ is the count in bin i and 

h^ is the smoothed value. 

Next, the smoothed color value histograms 
are converted to cumulative probabilities P ln as 
follows: 

n 



E h, (10) 
i=l 1 



P, 



10 ln ~ 80 

10 Eh, 

1=1 1 

Then, a set of normal cumulative 
probabilities P 2n having the same mean and standard 
deviation as the selected histogram are formed as 
15 follows (from Approximations for Digit al Computers. 
Hastings, C. , -Princeton Univ. Press): 

P 2n ' 1 " Z(y n> <V + b 2 t 2 + b 3 t3 + 
20 b 4 t 4 + b 5 t 5 ) + c(y n ) (ID 

where 

1 

le(y n )l < 7.5 x 10"8; t - J + pn 



25 



(x n " x) p = .23164 19 



b = .31938 1530 b 4 = -1.82125 5978 

30 b 2 = -.35656 3782 bj •- 1.33027 4429 

b 3 = 1.78147 7937 



and 



35 Z(y n ) 



1 -y 2 
e -^n 
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Next, the square root of the joint 
probabilities Pj n of the two sets of cumulative 
probabilities is formed as follows: 



jn 

The marginal probability P ffi of the square 
root of the joint probabilities is computed as: 

80 

P - Z P (13) 

10 m ^1 jn 

80 

and the posterior probabilities P of the square 

pn 

root of the joint probabilities are found as 
follows. The posterior probabilities are the 
15 cumulative probabilities of the shape corrected 
histogram. 

pn jn m 

Turning now to Fig. 12, the steps involved 
20 in normalizing the color value histograms to generate 
the color reproduction functions will be described. 
To normalize a histogram, the normal variate Z for 
all 80 color value bins in the contrast interval is 
computed. The normal variate Z is calculated from 
25 the cumulative probabilities P pn of the shape 

corrected histogram as follows (from Approximations 
for Digital Computers , Hastings, C, Princeton Univ. 
Press) : 

30 Z„ - *„ " 80 - &l , + «*p„> (15) 

1 + b x t n + b 2 t n 2 

where 



u(p pn )i < 3 x io 3 t n - J m d/P pn 2 ) 



a Q - 2.30753 b l - .99229 

a x - 0.27061 b 2 - .04481 
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The 256 Z values are stored in the color 
reproduction function look-up table 22. This 
process is applied to each of the three color value 
samples in the selected contrast interval. 
5 After the color reproduction function 

look-up tables are generated, all of the color 
values of the image are processed by applying the 
respective color reproduction functions to them. At 
this point, the processed color values from the 
10 image are dimensionless quantities representing Z 
values. 

To recover the processed image, these 
dimensionless quantities are given magnitude with 
respect to the original image and the output medium 

15 by multiplying the Z values with a multiplier that 
adjusts the overall contrast of the processed image. 
To adjust the color balance of the image, a constant 
term is added to each of the three primary tone 
values. The additive constant term relates the • 

20 processed image values to the density of the output 
medium for the respective color, thereby causing 
equal Z values in all three colors to be reproduced 
as a shade of gray. 

Appropriate values for the multiplier that 

25 adjusts the overall contrast and the additive 
constants that determine the color balance are 
determined as follows. The multiplier is computed 
based on the statistics of the green color values 
alone, but is applied to all three colors. 

30 The intrinsic contrast of natural scenes 

can be quantified in terms of the standard deviation 
of log reflectance of edges in the scene or the 
density representation of these log reflectances in 
the photographic image. On the average the 
3 5 approximate relationship between the two is given by: 

a n - G • a D (16) 
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where : 

G - average gradient of the photographic 

Film (relates o R to some specific 
reproduction medium contrast) 
o R » standard deviation of log reflectance 
based on a large number of original 
scenes 

a Q » standard deviation of density 

Typical values for <* R and G for color 

negative photographic film are .31 and .68 
respectively, such that a Q is .21. 
Departures from this average contrast must be 
15 compensated. A general equation may be stated as: 



10 



where: 



<* - m . f(a ) + b (17) 
z s 



a = individual scene standard deviation, 

s 

from the selected contrast interval 

20 m and b are system dependent constants and 

f(c ) is some function of the sample standard 
s 

deviation 

o « the multiplier applied to the values 

z 

obtained from the color reproduction 
25 function. 

A simple and satisfactory implementation is 
obtained from: 

b - o D . (1.0 - m) (18) 

a - m . a + b (19) 
z s 

30 where: 

m is typically between .6 and .8. 

The sign of a z is positive if the 

reproduction has the same polarity as the original 

image (negative-to-negative or 

35 positive-to-positive). If the reproduction has a 

polarity of an opposite sense with respect to the 

original, e.g., negative-to-positive, then the sign 

of a is negative, 
z 
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For example, if a color negative image is 
to be printed directly onto color photographic 
paper, the log exposure for the desired mean paper 
density; for each color is simply added to the 
5 translated, contrast adjusted values of the 
respective colors. The complete calculation is 
given by: 

log E ZD - -* 2 . Z D + log E A (20) 
where: 

10 log E A = log exposure required to obtain 

the aim paper density 
translated Z value for some input 
density in the original image 
log E ZD - log exposure for Z Q . 
15 Industrial Applicability and Advantages 

The method of processing digital color 
images according to the present invention is useful 
in the graphic arts and photographic printing fields 
to automatically adjust the local contrast and color 
20 balance of digital color images produced from 

photographic color film. The method is advantageous 
in that a greater percentage of high quality images 
are produced automatically, without the need for 
operator intervention, than by the methods of the 
25 prior art. The method overcomes the problem of 
undesirable color shifts and tone scale problems 
caused by noise in the samples of color values 
employed to generate the color reproduction 
functions. 
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Claima: 

1. A method of processing a digital color 
photographic image by applying color reproduction 
functions formed by normalizing samples of color 

5 values from the informational part of the image, to 
the color components of the digital image, 
characterized by the steps of correcting the shape 
of a distribution of color value samples toward a 
normal distribution having the same mean and 

10 standard deviation as the sample distribution prior 
to forming the color reproduction function. 

2. The digital color image processing 
method claimed in Claim 1, wherein the correction 
comprises forming the cumulative probabilities of 

15 the sample of color values, forming a normal set of 
cumulative probabilities with the same mean and 
standard deviation as the sample distribution, and 
forming the square root of the joint probabilities 
of the two sets of cumulative probabilities. 

20 3. The digital color image processing 

method claimed in Claim 2, further comprising the 
step of forming the posterior probability of the 
square root of the joint probabilities. 
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